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Abstract 

■ We introduce and analyze an abstract algorithm that aims to find the projection onto 

ch ■ a closed convex subset of a Hilbert space. When specialized to the fixed point set 

of a quasi nonexpansive mapping, the required sufficient condition (termed "fixed- 
point closed") is less restrictive than the usual conditions based on the demiclosedness 
principle. A concrete example of a subgradient projector is presented which illustrates 
the applicability of this generalization. 
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1 Introduction 

Throughout this note, we assume that 

X : 

X is a real Hilbert space with inner product (•, •) and norm || • ||. (1) 
Suppose that 

C is a closed convex subset of X, and Xo G X. (2) 

We are interested in finding the projection (nearest point mapping) PqXq, i.e., the unique 
solution to the optimization problem 

d(xQ,C) :— min lixo — ell, (3) 
cec 
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especially when C is the fixed point set of some operator T : X — > X. It will be convenient 
to set, for arbitrary given vectors x and y in X, 

H(x,y) := {z G X | ||y-z|| < ||x-z||} = {z G X | 2 (z, x - y) < ||x|| 2 - ||y|| 2 }. (4) 

Note that H(x, y) is equal to either X (if x = y) or a halfspace; in any case, the projection 
onto H(x,y) is easy to compute and has a well known closed form. In order to solve ©, 
we shall study the following simple abstract iteration: 

Algorithm 1.1 Recall the assumption ((2]), and set Cq = X. Given n G N and x n G X, pick 
y n G X, and set 

C M+ i := C„ n H(x„,y n ) and x n+ i = Pc„ +1 *o- (5) 
Observe that if the sequence is well defined, then 

C D Ci D • • • C M D C M+ i ^ • • • (6) 

and so 

||*o ~~ *«|| — ^(^0/C w ) < rf(xo/C„+i) = \\xq — x n+ i\\ (7) 
for every n G N. It then follows that 

/3 := lim \\xq — x n \\ = sup ||xo — x n \\ £ [0/+ 00 ] (8) 

is well defined. Furthermore, if m < n, then x w G C m which implies 

(x n x m , xq Xffi) < (9) 

as well as 

||y m x n \\ < \\Xffi Xfi\\ (10) 
because x„ G C„ C C m+1 C H(x m ,y m ). 

Lemma 1.2 Suppose that the sequence (x n ) ne fq is generated by Algorithm \l.l\ Suppose also that 
for every subsequence (x/tJweN of (x n ), we have 



x kn -> x 

X k n ~ Vk n -> 



=> X G C. (11) 



Then every bounded subsequence of(x n ) ne fj must converge to a point in C. 

Proof. Let (x kn ) ne f^ be a bounded subsequence of (x n ) n eiN- h follows from © that f> < 
+oo. Let n > m. Using d9), we obtain 

ll x fc„ -*k m \\ 2 = \\xk n -xo\\ 2 - \\x km -x \\ 2 + 2{x kn -x km ,xo-x km ) (12a) 



\\ X kn 


~ Xq\\ 2 - 


\\x k 


- *o|| 


IK 


- x o\\ 2 ~ 


\\x k 

1 1 ft-m 


-*oll 



2 (12b) 

->. £ z - = asn>m^ +oo. (12c) 

Hence (xfc n ) n eN is a Cauchy sequence. Thus, there exists x G X such that Xfc K — > x. Now, 
from (US), we obtain \\y kn - x kn+1 \\ < \\x kn - x kn+1 || ||x - x|| = and thus y kn - x kn+l -> 
0. It follows that x fcn - y fcn = (x kn - x kn+} ) + (x kn+1 - y kn ) ->■ 0. Now apply (HE). ■ 
The previous result allows us to derive the following dichotomy result. 
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Theorem 1.3 (dichotomy) Suppose that (x n ) ne fq is generated by Algorithm \l.l[ that (Vn G N) 
C C C M , and that for every subsequence (xi n ) nE fj of (x n ), we have 



x k„ -> * 

^fc„ - yfc„ -> 



=> x G C. (13) 



T/ien exactly one of the following holds: 

(i) C / and x n — > PqXq. 

(ii) C = and \\x n \\ — > +oo. 
Proof. Note that 

(Vn G N) ||xq — *«|| = d(xo,C n ) < d(xQ, C). (14) 



(i)j Assume that C / 0. Then (x m )„ 6 ]n is bounded by (|T4|) . By Lemma [L2l x := 



lim n6 ]N x n G C. In turn, ([T4|> yields ||xo — x|| < rf(xo, C). Therefore, x = Pc x o> as claimed. 

(ii) Suppose that \\x n || 7^ +00. Then (x n ) w6 ]N contains abounded subsequence which, 
by Lemma [L2l must converge to a point in C. Hence if C = 0, then ||x M || — > +co. ■ 

Remark 1.4 Several comments regarding Theorem II .31 are in order. 

(i) Algorithm II .11 is related to a method studied by Takahashi et al in ||T3l Theorem 4.1]. 
(See also ||TTl IT21 Theorem 2] for Bregman-distance based variants.) While that 
method is more flexible in some ways, our method has the advantage of requiring 
neither nonexpansiveness of the given operator nor the nonemptiness of the target 
set. 

(ii) Our proofs are different because we establish strong convergence directly via a 
Cauchy sequence argument. The proofs mentioned in the previous item are based 
on a Kadec-Klee property or on Opial's property. (We expect that our proof will 
generalize to Bregman distances, possibly incorporating errors and families of op- 
erators.) 

(iii) As we shall see in Section |3]below, our framework encompasses subgradient projec- 
tors which are important in optimization. 

(iv) The computation of the sequence (x n ) ne ^ requires to compute projections of the 
same initial point Xo onto polyhedra (intersections of finitely many half spaces). While 
this is not necessarily an easy task, this is considered to be a standard quadratic pro- 
gramming problem in convex optimization. Moreover, since C n+ \ is constructed 
from C n by intersecting with the halfspace H(x n ,y n ), it seems plausible to apply 
active set methods (with a warm start) to solve these projections. While a detailed 
excursion on this matter is beyond the scope of this paper, we do refer the reader to 
[ll [9], [TUJ for references on computing projections onto polyhedra. 
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2 An application to finding nearest fixed points 

Recall that T : X -4- X is called nonexpansive if 

(VxeX)(VyeX) ||Tx — TyH < \\x-y\\; (15) 

moreover, T is tjwasz nonexpansive if 

(Vx € X) (Vy € Fix T) ||Tx - y|| < ||x - y||, (16) 

where Fix T:= {x£X|x = Tx}. See HZHSUSI for further information on the fixed point 
theory of nonexpansive mappings. 
The next result is readily checked. 

Lemma 2.1 Let T : X — > X be quasi nonexpansive. Consider the following properties: 

(i) T is nonexpansive. 

(ii) T is continuous. 

(iii) T is fixed-point closed, i.e., if and x n — Tx n — > 0, then x € Fix T. 
Then [(7)H l(n')M(7n)| 



Remark 2.2 It is well known that if T : X — >■ X is nonexpansive, then 

*AXto} feFixT; (17) 

this is the famous demiclosedness principle — to be precise, this states that Id — T is demi- 
closed at 0. For recent results on this principle, see and the references therein. It is clear 
that demiclosedness of Id — T at implies that T is fixed-point closed; the converse, how- 
ever, is false (see Example !3.2| below). 

Our main result now yields easily the following result, which by Lemma IZT1 is appli- 
cable in particular when T is nonexpansive. (See also Ifl3l Theorem 4.1] for extensions in 
the nonexpansive case.) 

Theorem 2.3 (trichotomy) Let T: X -4- X be quasi nonexpansive and fixed-point closed, let 
xq € X, and set Co := X. Given n £ N and x n , set 

C n+ i := C n nH(xn,Tx n ) and x n+1 = -Pc„ +1 *o- (18) 
Then exactly one of the following holds: 

(i) Fix T^0 and x n — > P^t^o- 

(ii) FixT = and ||x n || — > +oo. 

(iii) Fix T = and the sequence is not well defined (i.e., C n+ \ is empty for some n). 



Proof. Set C = FixT, and (y n ) n eN — {Tx n ) ne fq provided that (x M )neN is well defined. In 
this case, it is clear that ((TTj) holds because T is fixed-point closed. 



Assume that C 7^ 0. If C n 7^ and C C C n , then (Vc G C) ||Tx n — c|| < \\x n — c\\ 
and so c G H(x n , Tx n ). It follows that C C C n+ i and the sequence (x„) m <=]n is well defined. 
The conclusion thus follows from Theorem II .31 



(ii)Sz(iii) Assume that C = 0. If (x m ) m€ ]n is not well defined, then (iii) happens. 



Finally, if (x m ) m6 ]n is well defined, then (ii) occurs again by Theorem II .31 



Let us now illustrate the three alternatives in Theorem 12.31 

Example 2.4 Suppose that X = R and set T := aid, where a £ [0, 1[. Then T is non- 
expansive with FixT = {0}. Let xq > 0. Then Txq = axo and Q = ]— 00, (a + 1)/2xq\. 
Thus, %i — (a 4- 1)/2xq. It follows inductively that {x n ) ne ^ is well defined and 

(Vn e N) x„ = ((a + l)/2)"x -> = Ppixrxo, (19) 
as is also guaranteed by Theorem |2.3|[i)[ 

Example 2.5 Suppose that X = R and set T: X — >■ X: x 1— > x + a, where a. > 0. Clearly, T 
is nonexpansive and Fix T = 0. One checks that x n = Xo + not/ 2; hence, \x n \ — > +00. 

Example 2.6 Suppose X = R, let o~: X — > {—1, +1}, and set Tg-: X X: x \-t x + a(x). 
For trivial reasons, T a is quasi nonexpansive (since Fix T a = 0) and Tg- is fixed-point 
closed (since ran(Id —T a ) C {+1, —1}). We now assume that c(0) = 1 and c(l/2) = — 1. 
Let Xo = 0. Then Q = [1/2, +00 [, x\ = 1/2 and C2 = Q n ] — 00, 0] =0, which means the 
algorithm terminates. 



3 Subgradient projector 

The astute reader will ask whether the fairly general assumptions on T in Theorem 12.31 
i.e., that "T be quasi nonexpansive and fixed-point closed", are really needed in applica- 
tions. In this section, we provide an example that not only requires this generality but 
that also does not satisfy the usual demiclosedness type assumptions seen in this area. 
To this end, let 

/:X^R (20) 
be convex, continuous, and Gateaux differentiable such that / > and 

C := {x G X I f{x) < 0} = {0}. (21) 

Write g := V/ for convenience. The subgradient projector in this case is defined by 

{x, if x = 0; 

Then it follows (from e.g., |4, Proposition 2.3]) that T is quasi firmly nonexpansive, i.e., 

(Vx G X) (Vy € Fix T) \\Tx - yf + \\x - Txf < \\x - yf. (23) 



5 



Lemma 3.1 The following hold: 

(i) T is quasi nonexpansive. 

(ii) T is fixed-point closed. 

(iii) T is continuous at 0. 

(iv) Iff is Frechet differentiate, then T is continuous. 



Proof, (i) This follows immediately from p3). 

(ii) Let (x„) w6 ]n be a sequence in X such that x„->i and x n — Tx n — > 0. We assume 
that i / (for if x = 0, then the conclusion is trivially true) and that (x n ) ne fq lies in 
X \ {0}. To reach the required contradiction, observe first that the continuity of / yields 

f(x„) -> f(x) > 0. Now x n - Tx„ ->• \\x n - Tx n \\ ->• f(x n )/g(x„) -> 0; thus, 

lim||g(x n )|| =+oo. (24) 

On the other hand, g is strong-to-weak continuous (see, e.g., [5, Proposition 17.31]); there- 
fore, the sequence {g{x n ))neiN converges weakly to g(x). In particular, )«eN is 
bounded — but this contradicts (|24|) . 



(Til)] Convexity yields (Vx G X \ {0}) (0 - x, V/(x)) < /(0) - /(x), which implies 
/(x) < (x,g(x)) < ||x||||g(x)||; thus, /(x)/||g(x)|| < ||x||. Hence lim x _>.o Tx = = TO, as 
claimed. 



(iv) If / is Frechet differentiable, then g is strong- to-strong continuous (see, e.g., |5j 
Proposition 17.32]), which in turn yields the continuity of T on jx € X | g(x) 7^ 0} = 
X\{0}. " ■ 

Note that Lemma 13.11 guarantees the applicability of Theorem 12.31 to the subgradient 
projector T. 

Example 3.2 Suppose that X = £ 2 = {x = {x n ) n >\ | E n >i \ x n\ 2 < +°o} and set 

/: X -> R: x = (x„)„>i ^ J] nx^". (25) 

n>l 

Then / is well defined, convex, and continuous (see ||3] Example 7.11]). Moreover, / is 
Gateaux differentiable with g(x) = V/(x) = (2n 1 x^ l ~ l ) n >\. Denote the sequence of 
standard unit vectors by (e M ) n >i, and set 

(Vn > 1) x„ := ei + e„ ^ e 1 (26) 

For n > 2, we have /(x n ) = 1 + n, g(x n ) = 2e\ + 2n 2 e n ; hence ||g(x n ) || = \J\ + 4n 4 and 
thus/(x n )/||g(x n )|| — > 0. It follows that x n — T(x n ) — > 0. Since 



x M ei 
x n - T(x n ) -)> 



A ei = 0, (27) 



we see that Id — T is nof demiclosed at and that T is not weak-to-weak continuous how- 
ever, T is fixed-point closed by Lemma |3T^H) 



Remark 3.3 Some comments regarding Example 13.21 are in order. 



(i) This example illustrates that some of the sufficient conditions demi-closedness type 
conditions provided in the literature (see, e.g., [6, Proposition 2.2]) to guarantee con- 
vergence are actually not applicable to the subgradient projector T of the function 
/ defined in Example 13.21 However, Theorem 12.31 is applicable with T because of 
Lemma 13. 11 

(ii) Some additional work (which we omit here) shows that / is actually Frechet differ- 



entiable on X. Thus, by Lemma [3J Tiv) T is actually strong- to-strong continuous. 



(iii) It also follows from the classical demiclosedness principle that T is not nonexpan- 
sive. 
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